EDGE SCALING OF THE /3-JACOBI ENSEMBLE 

DIANE HOLCOMB, GREGORIO R. MORENO FLORES 

Abstract. We study the scaling limit of the spectrum of the /3-Jacobi ensemble at 
the soft-edge and hard-edge for general values of /3. We show that the limiting point 

(^ ' processes correspond respectively to the stochastic Airy and Bessel point processes 

CN ! introduced in \W\ and [50]. 
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1. Introduction 



Random matrices are well known in the mathematical community as a model coming 
Ph ■ from nuclear physics, although they were first introduced in statistics. The model con- 

Ph . sidered by Wishart f26j (now known as Wishart matrices) can be described as follows: 

»^ ! let A^nxm denote the space of n x m matrices with complex (resp. real) valued entries, 

c^ \ Take a matrix X G A^nxm with independent complex (resp. real) Gaussian entries, 

then XX"^ G A^nxn is said to have a (n, m)-Wishart distribution. It corresponds to the 
sample correlation matrix for a sample drawn from a multivariate complex (resp. real) 
CN ! normal distribution. 

However the most famous model of random matrices is probably the GUE ensemble: 
[■*-. ' let {^iji rjij : 1 < / < j < A^} be an array of independent standard normal random 

variables. The diagonal entries of a GUE matrix correspond to Xi^ = C,i,i while the 
off-diagonal entries are defined as Xij = 2~2(^;j + ir]ij) and Xi^i = 2"2(^;j — irjij), 
(3 ! for Z < j. This model was introduced by Wigner as a toy model for the spectrum of 

CN I heavy atoms, by observing that the spacings between consecutive eigenvalues of a GUE 

random matrix mimic the spacing between different energy levels of these atoms (see 
[TB] and references therin). 
^ ! In both models, when the size of the matrix grows, the properly rescaled empiri- 

cal spectral measure converges to a compactly supported distribution called the semi- 
circular law in the case of the GUE and the Mar chenko- Past ur law in the case of the 
Wishart model. In this last case, the limit law depends on the ratio of the parameters 
m and n. 

The compact support of the limiting empirical laws suggests that an interesting 
phenomenon should occur near to the edge of the spectrum. This was first studied in 
the GUE case where it was discovered that the law of the bottom of the spectrum, after 
centering and rescaling, converges to a point process (the stochastic Airy process). In 
particular, the law of the properly centered and scaled smallest eigenvalue converges 
the GUE Tracy- Widom distribution [22j. 

Substantial differences appear between the GUE and the Wishart ensemble. In the 
later case, for certain values of the parameters, the lower edge of the spectrum will 
converge to which is the leftmost possible value for the eigenvalues of a positive 
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definite matrix. This in turn suggests that the spectrum should converge to a different 
hmiting point process supported on the positive half-hne, the Bessel process |23j . This 
extreme situation is known as a hard-edge, in opposition to the soft-edge situation 
described in the previous paragraph. While the Wishart ensemble can lead to a soft- 
edge or a hard-edge depending on the parameters, the GUE only leads to a soft-edge. 
One can, of course, also consider the upper edge of the spectrum which gives a soft-edge 
in both cases. 

A straightforward generalization of the GUE and the Wishart ensemble leads to the 
/3-Hermite and /3-Laguerre ensembles. The joint density of these point processes are 
given respectively by: 



-I "■ 

^' 1=1 j<k 

1 " a 



/3 



^'5'"''" i=l j<k 



The /3-Hermite ensembles include the classical random matrix ensembles, such as the 
GUE (for (3 = 2), the GOE (for (3 = 1), which is the real analogue of the GUE, and 
the GSE (for (3 = 4), the symplectic analogue of the GUE. The /3-Laguerre ensembles 
correspond to the complex Wishart model when /3 = 2. /3 = 1 and 4 correspond 
respectively to real and quaternion valued analogues. 

In both settings, the cases (3 = 1, 2 and 4 have the particularity to be solvable and 
can be studied by means of asymptotics of orthogonal polynomials [IE] . In the general 
(3 case, the solvability is lost, together with a natural interpretation in term of classical 
random matrix ensembles. The soft and hard edge limits for these general ensembles 
were considered in fT9] and [20] respectively, leading to the stochastic Airy process and 
the stochastic Bessel process, respectively, in the soft-edge and the hard-edge case. This 
approach was anticipated in [11], where tridiagonal matrix models associated to the (3- 
Laguerre and Hermite ensemble [6] were conjecture to converge to continuum random 
operators. It is worth noting that the link between these random operators and the 
classical results involving the Tracy- Widom distribution remains obscur. To the best 
of our knowledge, the only result in this direction is [T] where a spiked-random matrix 
model is investigated. 

The scaling limit of eigenvalues in the bulk of the spectrum for the /3-ensembles is 
studied in [21] and [12]. We will not address this type of questions here. 



The object of study in this paper is an "eigenvalue" ensemble derived from the 
following class of matrices. We take an rii by n matrix M with each entry independently 
drawn from the standard normal distribution, the matrix X = M'^M is one of the n 
by n Hermitian matrix models introduced by Wishart. If we assume ni > n we know 
the resulting matrix is almost surely invertible and so it is reasonable to consider A = 
X^/'^(X + y)~^X^/^ where Y is constructed in the same manner with parameters n2, n. 
Consideration of this type of matrix first arose in statistics (MANOVA, or multivariate 
analysis of variance, uses the base matrix model to study the interdependence of several 
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dependent and independent variables). The resulting matrix A is again Hermitian and 
joint density function of its eigenvalues is given by 

1 " 

//3,n,ni,n2(Al,. . . , A„) = — ||A"(1-Ai) |||Aj-Afc| l{A,e[0,l], V J} 

where a = f (?t-i — n + 1) — l,b = f (?t-2 — n + 1) — 1, Z is a constant dependent on 
the parameters, ni,n2 > n and /3 = 1. If instead of drawing from the standard normal 
distribution we had chosen a complex normal distribution, we would have had the same 
joint density function with (3 = 2. These cases were extensively studied by Johnstone 
in [H]. 

Note that the eigenvalues lie inside the interval [0, 1], unlike the Hermite or Laguerre 
cases where the spectrum is unbounded. The limiting spectral density is given by the 
following theorem: 

Theorem 1. ^ Let fin = ^"^i^Xi with {Xi} the eigenvalues of J{n,ni,n2, (3), ni,n2 > 
n, rii/n — >■ ■ji, and 77,2/77, — >• 72, then fj.n{x) converges weakly to p{x), where 

pU) = 2^ . V(A+-x)(a;-A,) 
7i + 72 x{l - x) 

Here A± denotes the upper and lower edges of the spectrum which are given by 

.^x A = I V^l(^l+^2-l) ^ v^ 



7i + 72 7i + 72 

Note that the expected edges of the J{n,ni,n2, (3) spectrum are given by 

_ I ^ynl{nl + 712 - n) ^/rm^ 



Ui +772 Til + 772 

In general we need not restrict ourselves to the cases where [3 = 1, 2 or 4. For general 
(3 the joint density function defines a more general random point process called the 
/3-Jacobi ensemble and will be denoted J{n,ni,n2, (3). This is a point process that can 
no longer be associated to any natural ensemble of random matrices for /3 7^ 1, 2 or 4. 
However, we will sometimes refer to the points of the point process as the "eigenvalues" 
of the /3- Jacobi ensemble. This slight abuse of terminology will in fact be made rigourous 
later as we will see that it is possible to construct a family of tridiagonal matrices in 
such a way that the law of their eigenvalues corresponds to a /3-Jacobi ensemble. 

This paper will focus on the behavior at the edge of the spectrum as n, ui and ?72 
grow to infinity. This approach relies on a tridiagonal representation of the /3-Jacobi 
ensembles [13] and the techniques developped in |19j and [20] • The higher number 
of parameters makes the phase diagram richer. As there are both a lower and an 
upper bound on the spectrum, appropriate tuning of the parameters can lead to any 
combination of soft/hard upper /lower edges. With our notations, the asymptotics of 
ni with respect to n will determine the nature of the lower edge, while respective 
asymptotics for 712 will determine the upper edge. 
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More precisely, if we write ni = n + a„ then if a„ — >■ a < oo there will be a hard edge 
at the origin (it is easy to see from ([T]) that the expected lower edge converges to 0). In 
this case, we will prove that the rescaled spectrum converges to the stochastic Bessel 
process from [llj. Our analysis is based on general results proved in [20]. 

If a„ —7- oo, we will see a soft edge. This situation is more delicate, as it is possible 
to have a„ — )■ +oo and still have the lower edge converging to 0. We will restrict to 
the situation liminf ni/n > 1, which implies that the lower edge will stay away from 0. 
We will prove that the rescaled and center eigenvalues converge to the stochastic Airy 
operator introduced in [11]. Our approach follows [19]. The most general soft-edge 
case, even in the Laguerre case, remains open (see [IS]). Similar considerations apply 
for the upper edge replacing rii by n2- 

Several works have been devoted to the edge behavior of the /9-Jacobi ensembles with 
varying degree of generahty (see for example [SI [H [9l [T71 [H]). The works [1] and [H] 
are restricted to the cases /3 = 1 and 2. Johnstone [T^ also provides fluctuation results 
for the top eigenvalue in the cases /3 = 1 and 2. All the aformentioned works treat the 
case of a single extreme eigenvalue. We note that the work [13] uses the results from 
[TU] and [20] to study very degenerate asymptotics for rii and n2 for which the Jacobi 
ensemble approximates the Laguerre ensemble. 

The bulk behavior of a larger class of /3-ensembles that includes the /3- Jacobi ensemble 
(at least for a whide family of parameters) as been studied in [2]. 

This work is organised as follows: in Section [2?T] we recall the tridiagonal representa- 
tion for the /3- Jacobi ensemble proved in [T3] (an alternative approach will be described 
in the appendix). Section [2^ and [X^ present our results on the soft-edge and the hard- 
edge respectively. Proofs in the soft edge cases are presented in Section [3] while the 
hard-edge case is treated in Section HI Many details are similar to the corresponding 
proofs in [19] and [20] and will be omited. 



Acknowledgements. The authors would like to thank Benedek Valko for introducing 
them to the field of random matrices and suggesting this problem. 



2. Results 

2.1. Tridiagonal representation. The core of our approach, following [l9j and [20] . 
rests heavily on a tridiagonal representation of Jn,ni,n2,/3- The first tridiagonal repre- 
sentation for the /3- Jacobi ensemble was given by Killip and Nenciu [15]. We will work 
with a somewhat simplified model which was introduced by Sutton ([21], Chapter 5). 
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Theorem 2. [15j The joint density of the eigenvalues of MM'^ is given by //3,n,ni,n2(A); 
where 

02C1 C202 

>S'3C2 



M = M, 



n,ni,n2,/3 



bnC-j 



n-1 



G„ 



with Cf + Sf 



hCf + S^ 



Ck 



1 and 



Ck 



'Beta ( —{rii — n + k), — (^2 — n + fc) 



' Beta ( -k, -{ui + n2 - 2n + k + 1] 



Note that MM'^ is indeed tridiagonal. A proof of this theorem is included in the 
appendix for the sake of completeness. 

2.2. Soft edge limit. The proof of the soft edge limit is derived using a more general 
limiting result by Ramirez, Rider and Virag [IS]. This result embeds a sequence of 
tridiagonal matrices as operators on L^[0, 00) and gives conditions for a weak limit 
under which convergence of the eigenvalues also holds. We use this result to show that 
the point process J{n, ni, n2, f3) converges to eigenvalues of a random operator. 
We begin by defining the "stochastic Airy operator" (SAE^) . Let 

(2) «,._^ + ,+ _L,w 

where we take b' to be a white noise. A precise definition and many properties of this 
operator can be found in [19]. We review the necessary ones below. 

For our purposes it is sufficient to define an eigenfunction/eigenvalue pair in the 
following way: Let 

L* = |/GL2[0,oo)|/(0) = 0and f {f'f + {I + x)f^dx < oo\ , 

then {(f, A) is an eigenvalue/eigenfunction pair for "H^ if ||v?||2 = l,(p E L* and 



(3) 



¥'"(^) = -^'Pi^)b'ix) + {x- X)ipix) 



holds in the sense of distributions. This may be written as 

(4) ^'{x) - v'{0) = -^v{x)b{x) - -^ y^ v'{t)b{t)dt + j^it- XMt)dt. 

In this sense, the set of eigenvalues is a deterministic function of the Brownian path b. 
Moreover the eigenvalues are "nice" in the following sense: 
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Theorem 3. [19] With probability one, the eigenvalues of 7i/3 are distinct with no 
accumulation point, and for each k > the set of eigenvalues of T-Lp has a well defined 
{k + l)st lowest element Afc(/3). 

The Airy 13 point process is given by the eigenvalues of "H/?. Our first resuh shows that 
the spectrum of the Jacobi ensemble near to the soft edge converges to this point process 
after appropriate scaling and centering. 
Let us introduce some notation: Take 

(5) c^ = ^^, s^- "^ 



Ui +n2 ni+ n2 

(6) c = , s^ = 

ni + n2 ni+ ^2 

with c, s, c and s all nonnegative. Under this notation we have that the expected edge 
of the spectrum is given by 

A± = (cs ± scf. 
We define our scaling factor to be 



,2 



mz, , cscsy/ui + n2 



2/3 



(7) a„ = — ^, where m„ = _^ 

cscs lcs[c'^ — s^) + cslc^ — S^J 

We now state the scaling limit near the soft edge. 

Theorem 4. Let Ai > A2 > • ■ ■ > A„ denote the ordered eigenvalues of J(/3,n, 711,712), 
and assume liminf 712/71 > 1, then 

(«„(A+-A,)) _ ^ (Ao(/3),...,Afc-i(/3)) 

jointly in law for any fixed k < 00, as 71 —> 00. 

Remark 5. This theorem describes the limiting behavior of the /3- Jacobi ensemble in 
the upper soft edge situation. This is sufficient to determine the behavior in the lower 
soft edge because J{n,ni,n2, P) is symmetric in ni and 712. That is, the reflection of 
the density of J{n,ni,n2, P) with respect to x = 1/2 is the corresponding density for 
J(r7,7i2,r7i,/3). 

Remark 6. In the situation where iii and 712 are constant multiples on 71, then a„ = 
C7i^/^ for some constant c. One can compare this with the scaling exponents in the 
Tracy- Widom result. In fact in the case where liminf 712/71 > 1 + e. Then with a little 
bit of work one can show that there exist constants ci and 02 depending only on e so 
that Cin^/'^ < nin < 02^7^/^. 

Remark 7. While we expect a soft edge type result for /3- Jacobi spectrum in the case 
where 712 = n + an and a„ — )■ 00 we restrict to the case where liminf 712/71 > 1. We 
make this restriction on 712 because, as the previous remark suggests, the order of 7?i„ 
can change substantially which will render many computations invalid. A similar gap 
exists in the /3-Laguerre case for the lower soft edge. 
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2.3. Hard edge limit. The proof of the hard edge hmit will follow largely from the 
proof of Ramirez and Rider in [20] . We will formulate a more general theorem which 
gives conditions for convergence of the eigenvalues, and apply this in the specific setting 
of the /3-Jacobi ensemble. The main idea is again to embed the tridiagonal matrices as 
operators and show that operator convergence implies convergence of the eigenvalues. 
However the operator convergence is not shown directly, instead we work with inverse 
operators to draw our conclusions. 

For convenience and in analogy to the /3-Laguerre ensemble, we will focus on the 
lower hard edge. We can see from Remark [5] that this is indeed sufficient to determine 
the upper edge as well. 

We recall the definition of the stochastic Bessel operator, studied by Ramirez and 
Rider in [20] to describe the limit of the Laguerre ensemble in the hard-edge case. The 
operator acts on functions on IR+ and is given by: 



2 
(a + l)x + —=h{x) 

vP 



d 



-ax i=b{x) 

V/3 



d 
dx 



•S/j.a = - exp 
where h{x) is a Brownian motion, a > — 1 and /3 > 0. This can be rewritten as 

With Dirichlet boundary conditions at and Neumann conditions at infinity the inverse 
operator as given by Ramirez and Rider [20] is: 

The operator &^\ is non-negative symmetric in L^[M_|_,r7i] where 

We may then define the eigenvalues and eigenfunctions of 0/3^^ by taking the equation 
'S/s^ai^ = ^''P to mean ip = X(5p\ip. Moreover, it can be shown that the spectrum defines 
a simple point process as desired. 

Theorem 8. [20] With probability one, when restricted to the positive half-line with 
Dirichlet boundary condition (at the origin), &i3^a has a discrete spectrum of simple 
eigenvalues < Ao(/3, a) < Ai(/3, a) < ■ • ■ f oo. 

We will show that the Bessel operator will describe the limiting spectrum of the 
(/3,?T,,ni,n2)-Jacobi ensemble in the hard-edge case. 

Theorem 9. Let < Aq < Ai < ■ ■ • < A„_i be the ordered eigenvalues of J {(3, n, ni,n2), 
rrin = nn2 and 77-2 > n. Assume that [ui — n) ^ a E (—1, oo), then 



m„Ao,m„Ai,...,m„Afcj => f Ao(/3, a), Ai(/3, a), ..., Afc(/3, a) 
jointly in law, for any fixed k < oo as n ^ oo. 
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Remark 10. Previous work on both the hard and the soft edge of the /3-Jacobi was 
done through a couphng with the /3-Laguerre ensemble by Jiang [13] . This work covers 
the case where n/rii — > 7 G (0, 1] and n = o{-s/n2). Our work extends the results to all 
cases for which liminf n2/?^ > 1. 

3. Convergence of the spectrum at the soft edge 

We begin by stating a general result of Ramirez, Rider, and Virag [12] giving con- 
ditions for a sequence of operators to converge to the stochastic Airy operator in an 
appropriate sense. Our work will then consist of verifying the hypothesis of this theorem 
in the /3-Jacobi case. 

Let Hn : W^ ^ MJ^ be the linear operator whose associated matrix with respect to 
the standard bases is symmetric, tridiagonal with diagonal entries (2m^ + mn{yn,i,k ~ 
yn,i,k-i), k>l) and off-diagonal entries {-ml + mn{yn,2,k - i/n,2,fe-i)/2, k>l). 

We define define the step functions yn,i{x) = 2/n,i,[a;m„jla:m„G[o,n] and make the follow- 
ing assumptions: 

Assumption 1 (Tightness/Convergence) There exists a continuous process x i— )■ y{x) 
such that 

(z/n,i(a;); a; > O) i = 1, 2 are tight in law 

{yn,i{x) + yn,2{x)] X > o) =^ {y{x)] X > 0) in law, 

with respect to the Skorokhod topology. 

Assumption 2 (Growth/Oscillation hound) There is a decomposition 

k 

(9) yn,i,k = m~^ ^ r]n,i/ + tOn,i,k 

with T]n^i^k > 0, such that there are deterministic unbounded nondecreasing continuous 
functions r/(a;) > 0,({x) > 1, and random constants fin{^) > 1 defined on the same 
probability space which satisfy the following: The fin are tight in distribution, and, 
almost surely 

(10) ri{x) / fJ'n - fJ'n < Vn,iix) + T]n^2{x) < /i„(l + rj(a;)) 

(11) ^n,2(a;) < 2ml 

(12) \Un,l{0 - ^nAx)\^ + KM - ^n,2{x)\^ < fin{l + V^x) /({x)) 

for all n and x, ^ G [0, ?7i„] with |x — ^| < 1. 

Theorem 11. [19j Given Assumptions 1 and 2 above and any fixed k, the bottom, k 
eigenvalues of the matrix Hn converge in law to the bottom k eigenvalues of the operator 
H , where 

dx"^ 



H = -— + y\x). 



Here the eigenfunction/eigenvalue pairs of H should be understood in the same way 
as those of Up as shown in Section 12. 2[ We will show that a tridiagonal matrix with 
eigenvalues corresponding to the /3-Jacobi ensemble satisfies the requirements of the 
theorem with limiting operator l-Lp. 
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3.1. The /3-Jacobi model. We use the following tridiagonal model for the /3- Jacob! 
ensemble. Let 



^n,/3 



^n ^n^n-1 



^n—l^n-1 ^n~l^n- 



C2S2 >-'lC2 
CiSi 

with Ck,Sk,Ck, and Sk defines as in Theorem [2l Clearly cr^Zn^^Z'^jj) = a{Mn,pM'^p) 
in distribution. 

Recall the definitions of m^ and a„ from section [2^2] given in (JTj). We consider the 
matrix 

This matrix has diagonal and off-diagonal entries given respectively by 



m 



cscs 



and 



m. 



TTlji H :^z[CSCS — Cn-kJn-k^-^n-k^n-k-l)- 



CSCS 



Note that the term {cs + scY is the A-j. defined in the introduction. We define Ay. 

yn,i,k - yn,i,k~i with 



n,i,k 



^yn,l,k 
Ayn,2,k 



m. 



cscs 
2m. 



__(,C S -\- S C »-'„_j._Li tv„_j, L/„_i.b„ 



n~k+l n—k 



''n—kn—k) 



CSCS 



rr(CSCS Cyn—ki^n—k^n—k^n-k—l)- 



The proof now consists of verifying the hypothesis of Theorem [TTJ 

3.2. Checking Assumption 1. To show that if„ satisfies Assumption 1 of Theorem 
[TT] we use the following proposition which is a simple modification of Theorem 7.4.1 
and Corollary 7.4.2 in (TU]. 

Proposition 12 ([ID])- Let f E C^(]R+) and g E C^(R'^), and let yn be a sequence of 
processes with y„ = and independent increments. Assume that 



-E{Ay^y = /'(fce„)+o(l) 



Var {Ayn,k) = /(A;e„)+o(l), 



-E{Ay^y' = 0(1) 



uniformly for ken on compact sets as n —t- 00. Then ynif) = yn,[t/e„] converges in law, 
with respect to the Skorokhod topology, to the process f{t) + Lg{s)dhs, where h is a 
standard Brownian motion. 
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We take e„ = l/m„ and apply this to a slightly altered version of i/nA and yn,2- Take 

A ~ _ "^ra I' 2-2 I 2-2 q2 Pi2 ^2 q2 \ 

^yn,l,k — TzyC S -\- S C O j^U j^ (-^n-k^n-k 

cscs 

^yn,2,k = rr (cscs — Cn-k^n-k^n-k^n-k)- 

CSCS 

Computation gives 



n2 — k 9 s"^ — c^ 2(^2 — rii) 

"^'^ ni + n2- 2k rii + ^2 (ni + n2 - 2£)^ 



^2 



for some I G [0, k]. Similar expansions can be written for the other terms involved. We 
now note that for convergence on compact subsets it is sufficient to consider k < crrin < 
C2n^^^ by remark O Therefore, collecting terms we find that 

(13) m„i?Ay„,i,, = ^ ■ ^^'' ~ ''l^^' ~ ''^ k + 0(1). 

cscs Til + n2 

Lemma 13. Let X = C'!^^^Sl^_f^ with i and j positive integers, then 

Similar statements hold for Cn~k o-nd Sn-k- 

Here we take 0{l/{ni + ^2)^) to mean that there exists a constant C depending only 
on i and j so that the magnitude of the error is bounded about by C /{ni + ^2)^. This 
lemma will always be used in the event that Cn~k or Sn-k is raised to an odd power. 

Proof. For a < x G [0, 1] 

v^+^(x-a)-^(a:-a)^<v/i?<v/^+^(x-a)-^(a:-a)^ + ^^^, 

and for X < a G [0, 1] 

y^+^(x-a)-^(x-a)^ + t^<v/:^<v/^+^(a:-a)-^(x-a)^ 

To complete the proof what remains to be shown is that E{X'^ — EX'^Y = 0{l/{ni + 
^2)^). To accomplish this we make the following observation. If y ~ Beta(a, 6), then 
for i, j positive integers we have that 

(14) g(y(i - YY) = '° + ' - " ■ ■ ■ '° ^ \'° '^ + ' - ^ ■ V '^ t ''^ 

^ ' ^ ^ '' (a + 6 + z + j-l)---(a + 6 + l)(a + 6) 

direct computation then finishes the proof. D 

An application of this lemma shows that 

,^^, ^._ m\ c^s^{c^ - s^Y ^c^s^[c^ -'s^Y ^ ^ f ^l 
(15) mnEAyn,2,k = —^ ^ ^ ^ -k + O ' 



cscs 721+77,2 XUi + n2 
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Here we mean that for 1 < k < arrin there exists some constant C independent of 
k,n,ni,n2 so that the error is bounded by Cm^/ijii + 77,2). Together with (iT3ll this 
gives us that 

(16) mnE{Ayn,i,k + ^yn,2,k) = h 0(1) 

which verifies the first condition in Proposition [T2] with f[x) = x'^/2. 

The second and fourth moment computations can be done similarly. They give us that 

4 

(17) mnE{Ayn,i,k + Ayn,2,kf = ^ + ^(1)' ^^^ mnE{Ayn,i,k + ^VnXkY = o(l)- 

Note that, for the fourth moment, it is sufficient to bound mnE{Ayn,2,kY ^^'^ (breaking 
yn,i,k into pieces) to bound the corresponding moments of s^c? — S'^_^C^_^ and c^s"^ — 
^n-k^n-k- Therefore, Proposition [T2] can be applied and yields 

a;2 2 

yn,i,k + yn,2,k ^ y + 7^^*^^)' 

in law in the Skorohod topology. 

Recall that in all the above computations, we considered y instead of y. Consequently, 
all that remains to check the second part of Assumption 1 is to show that yn,i,k + 
yn,2,k — yn,i,k — yn,2,k couvcrges to the process in law in the Skorohod topology. One 
can check that the expectation and variance of the increments are of order 1/n and so 
the expectation and variance of the process go to on compact subsets. This together 
with a fourth moment bound gives us convergence to the process in law. 

Finally, the individual tightness of each {yn,i{x);x > 0), i = 1, 2 can be obtained 
along the same lines. 

3.3. Checking Assumption 2. To check this assumption we again work with the 
shifted processes yn,i,k and compare this with the original process. To this end we take 
Vn,i,k = mnEAyn,i,k, and similarly^ fj^^i^k = mnEAy^^i^k- Further, we will neglect the 
extra —1 found in the Cn-k and Sn-k terms and show the irrelevance later. We will 
show the inequality in fITOl) for f/(x) = x. Under these definitions we have 

m^ / o o 90 (ni — k)(ni + n2 — n — k) (n2 — k)(n — k) 

Vn,i,k = -^. ch^ + s^c^ - ^ -^ -— ^ - ^' ' 

cscs \ [ni + n2 — 2,kY [ni + n2 — i/cj 

2ml f ~~ filini- k)) f (1(712- k))fil{n-k))filin, + n2-n-k)) 

'nn2k = rr CSCS jo 

'" cscs\ §l^m+n2-2ky 

where f(x) = r(x + l/2)/r(x). 

We begin with the upper bound on fin,i,k + Vn,2,k- The general idea will be to treat 
Vn,i,k via a Taylor expansion with a uniform bound on the error term, and work with 
Vn,2,k in two regions. The first region will he 1 < k < an for some a < 1 and the second 
will be an < k < n — 1. On the first region we will again work with primarily with 
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Taylor expansion and find a uniform bound on tlie error in terms of a, for the second 
section we return to working witli the original fjn,2,k and show that for an < k < n — 1 
this can be bounded by Cak/nin- 
Using the inequality 

we get that for ni, n2 > n > /c 



^ 2m^, / ^^ Jirii - k)(n2 - k)(n - k)(ni + n2 - n - k) 

Vn,2,k < —^ cscs ■ — — 

cscs \ [rii + n2 — 2,ky 

^ ^ Ami I \/{ni - k){n2 - k){n - k){ni + n2 - n - k) 
+ 15 — — ' 



cscs 



f(n- A;)(ni + n2-2A;) 



2 



For convenience we will label the first line of the right hand side by Ak and the second 
line by B^- We will treat the second term B^ first. 

rrinBk 120 nin2n{ni + n2 — n){ni + n2)^ 

k (3 n{ni + n2 — 2n)'^{^yn{ni + n2 — n)(ni — n2) + y/n^n^i^n — rii — n2))^ 

This upper bound has a finite limsup. We now turn to fin,i,k + A^ ior 1 < k < an for 
some < a < 1. 

k /W,2 

r/n,i,fc + Ak = h —z-k 

m„ 2 

for some i G [1, an]. Here /(£) is the second derivative of fjnxk + Ak with respect to k. 
On this range of k we can find explicit upper bounds for 

m„k 

n 2 

in terms of n, ni,n2, and a which have finite limsup as n goes to oo. This together with 
our bound on B^nin/k is enough to give us a sequence of constants c„ so that 

k 

Vn,l,k + Vn,2,k < C„ 

for 1 < A; < an. For the remaining piece we work with fjn,i,k and fjn,2,k separately. 
irLnf]n,i,k rnl f 2{ni - n2){2n - ni - n2) Q{ni - n2){2n - ni - n2)k^ 



k cscs \ (ni + n2)'^ (ni + n2 — 2t}* 

for some 1 < i < k < n. Taking the obvious upper bound with i = k = n we have an 
upper bound on r]n,i,k for 1 < k < n which has a finite limsup. Returning to Ak we 
note that for an < k < n we have that 

k ~ an 
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From Remark [6] we have that this is an appropriate upper bound. Choosing the larger 
upper bound on the two sections gives us a sequence /i„ such that 

k 

Vn,l,k + Vn,2,k < /^n 

for 1 < k < n ~ 1. 

Turning to the lower bound we have the inequality 

^ml /^2g2 , „2g2 jni - k){ni + n2 - n - k) {n2 - k){n - k) 
"' ' "' ' ~ cscs \ (ni + n2 — 2A;)^ [rii + n2 — 2ky 



2ml I ~~ a/(^i - k){n2 - k){n - k){ni + n2 - n - k) 

^^ + ~^ ^^^^ ? ^ ^17^ 

cscs \ [ni + n2 — Iky 

One can then make arguments for 1 < A; < an similar to those employed in the upper 
bound, simply choose a small enough so that mnkf{i)/2 is bounded below by —1. For 
the remaining k we note that the derivative of the right hand side with respect to k is 

V („ - t) (n. + n, - a - t) (,, - n.) + V (n. - <:)(». - t) (2,, - ,,, - ,,,) - ' 

^y{nl - k){n2 - k){n- k){ni + n2 - n - k){ni + ^2) 
which is strictly greater then for 1 < k < n — 1. Therefore 

Vn,l,k+Vn,2,k > 

'^n /^ 2-2 2-2 [fii — an){ni + n2 — n — an) {n2 — an){n — an) 
cscs \ (rii + n2 — 2an)^ (rii + ^2 — 2an)^ 



2 



cscs 



2m^ / A/f^i — an)(n2 — an)(n — an)(ni + n2 — n — an) 

H rr cscs — — 

cscs \ [ni + 77,2 — 20:77,)^ 

This lower bound can be used to get the desired constants for an < k < n — 1 finishing 
the lower bound. To finish we make the following observation: By direct computation 
we can find an upper bound 5„ of order {rii + 772)"^^'^ such that 

\Vn,l,k + Vn,2,k — Vn,l,k — Vn,2,k\ < ^n- 

Therefore any error that comes from neglecting the —1 in the Cn-k and Sn-k terms, 
or working with the shifted process may be absorbed into the constant terms. This 
finishes the proof of the bound in (TTUj) . 
We now verify ( IT2l) : 



znin , — r^ c r^ c No ^^^nS-^ n—k^ n—k^ n-~k^ n~k~\ 

i^yn,2,k = rr (,CSCS — L-n-kJn-k'^n-kJn-k-l) = ^"^n — • 

CSCS CSCS 

Therefore since all of the relevant pieces are positive we have that 

m^EAyr.,2,k = 2ml ' ij; ^^^'"^^^"-^^^"-^^"-^^! < 2ml. 

cscs 

The proof of the oscillation bound (TT2l) is identical to the corresponding proof in [19] 
and follows from general martingale arguments. This ends the proof of the convergence 
at the soft edge. 



14 
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4. Convergence of the spectrum at the hard edge 

To show the convergence of the spectrum at the hard edge we will first state a more 
general theorem on convergence of eigenvalues. We will then show that this gives us 
Theorem [HI Though this is stated more generally then the result given by Ramirez and 
Rider in [20] the majority of the proof follows directly from their work. 

4.1. A more general setting. Let X„ be a lower bidiagonal matrix 



X„ 



We make the following assumptions on the entries: 

Assumption 1 There is a brownian motion -B(-), and functions r(x), s{x) and v^(a;) 

continuous on (0, 1) such that ioi y < x in (0, 1] 

(19) ^ r(x) 



ai 










-hi 


a2 


as 


-fcn-l 


a-n . 



^[nxj 



(20) 



J2 log f ^ J ^ six) - siy) + j ip{t)dBt. 

^ I nni I y 



k= lny\ 



Assumption 2 There exist tight random constants Kn and k^ such that 

Eak 



(21) 
(22) 



sup 

l<A:<n flfe 



< Kr, 



j-1 



^ log p ) - s{z/n) + s{j/n) < <(1 + T'l\i/n) + T''\j/n)) 
k=j ^'^^' 



Where T(x) = J^^^ip'^{t)dt. 

Assumption 3 Let Kc to be the integral operator with kernel 

kc{x,y) = Cr(x)e^(")-^(^) exp [CT^/\x) + CT'^^^y)] l{y < 
then Kc is Hilbert-Schmidt. 
Assumption 4 Let K be the integral operator with kernel given by 



X) 



k{x,y) = r(x)e'(^)-'(^) 



exp 



'p{t)dBt 



l{y < x). 



The operator {KK'^) ^ has discrete spectrum with simple eigenvalues < Aq < Ai < 
... t oo. 

Theorem 14. Let Xn he a lower bidiagonal matrix with entries that satisfy assumptions 
1, 2, 3 and 4- Denote the ordered eigenvalues of XnX^ hy Xq < \ < 1 < ..., then 

(Ao, Ai, ..., Afc_i) =^ (Ao, Ai, ..., Afc_i) 
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jointly in law in the Skorokhod topology for any fixed k as n ^ oo. 

Remark 15. Assumption 4 can be replaced by further conditions on r{x),s{x) and 
f{x) in assumption 1. We omit this here because in our case assumption 4 can be 
checked directly. 

Proof. We begin by computing X~^ and embedding the resulting matrix as an operator 
on L^(0, 1]. By Lemma 4 in [20j we can compute 

Ok 



The action of our operator on L^ will then read 

lnx\ [nxj-l 

where xj- = k/n. We denote this operator by K"^, and note that this is a discrete 
integral operator with kernel 



k"'{x,y) = — exp 
ai 






'i-L{x,y), 



where 1l(x,2/) = l{x e [xi_i,Xi))l{y e [xj_i,Xj)) and i > j. 
To complete the proof we need the following lemmas: 

Lemma 16. There exists a probability space on which all K^ and K are defined, and 
such that any sequence of the operators K^ contains a subsequence which converges to 
K in Hilbert- Schmidt norm with probability one. In particular for any n^ 't oo we can 
find a subsequence Uk' t oo along which 

lim / / \k'^'''{x,y){uj) - k{x,y){uj)\'^dxdy = 

^k'^'^Jo Jo 

almost surely. 

The remainder of the proof of Theorem [13] now follows from the proof of Theorem 1 
in [2n]. 

D 

Proof of Lemma [7^ We make the following observation: The noise term in the limiting 
process may be rewritten as 

\iz)db^ = biTix))-biT{y)). 

' X 

Here the equality is in distribution with a different Brownian motion b living on the 
same probability space. This can be used to show that limiting operator K is almost 
surely Hilbert-Schmidt. The remainder of the proof then follows from the proof of 
Lemma 6 in j20] . 

D 
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4.2. Proof of theorem [9l We now apply Theorem [14] to our setting. RecaU the 
tridiagonal ensemble of random matrices which spectrum corresponds to the /3-Jacobi 
ensemble. We look at a similar matrix with unchanged spectrum, which can be decom- 
posed into a product of two bidiagonal matrices. Specifically we take 



— 02C1 C2S2 
—S3C2 



W, 



n,/3 



-On.Gi 



n'-'n— 1 



Gri 



where the random variables Ck and Ck are again distributed as in Section 12.11 Clearly 
c"(W^n,/3W^f^^) = '^{Mn,iBM^j^). Recall that we are looking for the hard edge limit at the 
lower edge, therefore we will take ni = n + an, an ^ a & (—1, 00) with no restriction 
on n2 beyond n2 > n. 

We will apply Theorem [H] to the bidiagonal matrix ^Jm^Wn,|3 where rUn = nn2, and 
then show that the eigenvalue equation (p = X{KK'^)~^(p is equivalent to -0 = X<3g\ip 
completing the proof of Theorem [91 

In order to apply Theorem [TH we need to show that ^/m^Wn,|3 satisfies the assump- 
tions. All these assumptions will need to be verified in two cases. The first case will be 
when n2/n — )• 7 G [1, 00), and the second will be ^2 3> n. Note that these two cases 
are sufficient because in the general case for any subsequence we can find a further 
subsequence along which either n2/'n. — )■ 7 or n2 ^ n and so convergence of to the 
eigenvalues of (Sjs^a in those situations is sufficient. For clarity we note that the discrete 
kernel of K"^ is 



k'^{x,y) 



n 



-^exp 




^x&[xi-i,Xi)^y&[xj-i,Xj)- 



JUlnLyibi 

with lL(x,y) 

4.2.1. Verifying Assumption 1. 

Lemma 17. Assume that n2/n — )■ 7 G [1, 00), then for s G (0, 1 



lL(a;,y), 



n 



2x + 7 - 1 



ytTln^ \nx\ t^ \nx\ 

Assume that n2 ^ n then for x G (0, 1] 



7a/x(x + 7 — 1) 



n 



X 



^Jrrin^ \nx\ ^ \nx\ 

Both convergence statements hold in the Skorokhod topology. 
Proof. We begin by observing that 

Var Cl^ = 0{l/n) -)■ 0, as n -)■ 00. 
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And similarly Var S*^^ = 0(l/n), therefore the random variables converge to their 
expected values in L^ . Now to ensure convergence on the process level fix 5 > 0, then 
for k > nx, x > 6 we can find a constant c such that 

1 y/a + A; + 1 1 \^a + k \ , c 



and 



E{— " ' ' ^ ' — < 

,Cfc+i i/a + n2 — n + 2A; + 2 C^ i/a + ^2 — n + 2A;/ n 



2 



1 Vet + n2 — n + Zc + l 1 y/a + n2 — n + k \ c 
,Sk+i Va + n2-n + 2k + 2 Sk Va + n2 -n + 2kj ~ n' 

Kolmogorov's tightness criterion ensures that we have process convergence on the set 
[6, 1] . Let 5 — )■ to finish the proof. 

D 

Lemma 18. Assume that n2/n — )■ 7 G [l,oo). There is a Brownian motion b{-) such 
that for every y, x G (0, 1] with y < x we have 

lnx\—l 



(23) V,og ^-aUlog vMT^iiM +i±i^log(^ 



2 '^Vl + l-V i, ^^(s2 + js - S) 

Assume that 712 S> n. There is a Brownian motion b{-) such that for every y,x E (0, 1] 
with y < X we have 



Sk+iCk \ ^ , a i„„ fy\ , 1 /"^ dbs 



[nx\ — 1 

again with both convergence statements holding in the Skorohod topology. 

Before beginning the proof we note the following: 
Proposition 19. Let X ~ Beta{p,q), then 



E|log^/^^j =^{^o{p)-^o{q)), Varhog^^^j = ^{^ ,{p) + ^ ,{q)) , 

where \l'o and \l'i are respectively the digamma and trigamma function. Moreover as 

X — > 00 

(25) ^'(x) = %(x)='i + ^ + 0(x-\ 
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Proof of Lemma [73 We rearrange the process to have independent increments and then 
apply Proposition [12] with e„ = 1/n. 

[nxj-l / ~ \ [nxj-l / ~ 

J2 1°S ^tV^ = logC'Ln:.] - logCL„^j + 5^ log -fti^ 

k=lny\ \ ^'^^'^ / k=lny\ \^k+l^k 

Similar computation to the proof of Lemma [T7I give us that if n2/n — )■ 7 
And similarly if n2 ^ n 



log -^ ^ log p^ 

\Clny\J \y/y 

We now consider the process ?/„ with increments 

A?/n,fc = log(5'fc+i/Cfc+i) - log(5'fc/C'fc). 
In the case where n2/?T. — ?■ 7 we find that 

1 + a a 



and 



nVar (A|/„,„^) = -5- + -^7 — ^ tt + o(l). 

px p[x + 7 — 1) 



We can also check that nE{Ayn,k)'^ = o(l). By Proposition [12] we get the convergence 
statement in ( l23]) . 

Similar calculations in the case where n2 ^ n give you that 

nE{Ayn,nx) = h o(l), nVar (A|/„,„^) = -— + o(l), nE(Ayn,k)'^ = o(l). 

2a; px 

This gives us the convergence in (12^ . 

D 

4.2.2. Verifying Assumption 2. We now turn to the tightness conditions. For ( 12T]) we 
begin by using the sum bound: 



p(snp^.^^^L=>M) < ±P(C', 

\l<k<n Cfc V«n + ^2 - n + 2fc / ^ V 



2 '-^Ti "r '^ 

k < 



M2(a„ + ri2-n + 2A;) 



Now recall that for X ~ T{p,e), Y ~ r(g,^) we have that X/{X + F) ~ Beta(p,g). 
We then start by finding bound on X and Y before turning to the Beta distribution. 
In particular we compute P{X > NE{X)) and P{X < E{X)/N) for large A^: First 
notice that E{X) = p6 and so an application of an exponential Chebyshev's inequality 
with 6 = 1 gives us 

Pi^ >PN)<{-^J^ a^d P{X < p/N) < (^) ' 
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Using these bounds we can find an upper bound on 

p( X p+q 1 
\X + Y p N 

with exponent {p Aq). 

When apphed to our original setting, this bound is summable in k (as n — )■ oo), 
and moreover the resulting sum may be made as small as desired by increasing M. 
Therefore, for any e > we can choose M such that 



P [ sup — > M ) < e 

a<fc<n <-/fc va„ + n2 — n + 2k 



and so the Kn are tight. 

For the tightness of the k'^ we use the proof of Lemma 5 in [20j. That proof is a 
reworking of the upper bound in the law of the iterated logarithm and the proof in this 
situation proceeds with few changes. We note first that this section will again need to 
be done in two cases. We make the following definitions which are analogous to the A^ 
defined in [T?| . 
(26) 

A2 = i: [iog(s.«/c.«) - log (S./4)] - ii^iog (I) - ^log fl±^n^ 

■^ L V yj 2 \i J 2 \i + w) — n 

k—j 

and 

(27) B: = J2 [log (5/c+i/Cfc+i) - log (^fc/Cfc)] - ^ log ( ^ J . 

k=j ^ * ^ 

for X G [xj,Xj+i). Here A^ will be used in the case where n2/n — )■ 7 < cxd and the 

associated T{x) = 4 flog ^ + log _\^^ ). In the case where n2 ^ n the object of 

interest will be -B^ with T{x) = ^ log ^. 

The changes noted above together with the following claim are sufficient to show the 
k'^ are tight. 

Remark 20. The T{x) as defined in the general theorem differs from the T{x) defined 
here by a constant. This omission is permissible because we always consider 

C{l + T^/\x)+T^/\y)) 

and so the difference may be absorbed by the constant term. 

Claim 21. For all \ > sufficiently small (\ < (/3/2)[(a + 1) A 1] will do), if n2/n — )• 
7 < 00 then 



, \2 



log ( — ) + log 



(28) i?[e'^"-.]=exp 

2p \_ \Xj J \7 — 1 + Xj 

With |0n(j)| < C for constant C = C{a,f3,'y). And ifn2/n -^ 00 

(29) E[e^''^ = exp ||^log (^) + e„(j) 



e„(j) 
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With |e„(j)| < C for constant C = C{a, (3). 

Proof of claim. We have the following products to consider: In the case where n2/n — )■ 7 
we have 

and in the case where n2 ^ n 

'« "••"•>-n{fe)" (I)' (¥)■""■ 

Let's start by considering the portion of fl30|) and fl3Tl) of the form 



c \ i r^ 



k 



k=j ^ ^ ^ \ K 

We use independence write this as a product of expectations, then by taking logarithms 
we can consider each term of the resulting sum separately. For the fc-th term this gives 
us (logP)fc = h + Jk where, 

h= \ogTy^{n2-n + k + l) + -\ -\ogTl^{n2-n + k + l) 

+ logr (-{an + n2 -n + /c + 1) - - j -logT ( -(an + n2 -n + k + l) 
and 

Jk = logr (^{an + fc + 1) - ^"j - logr r|(a„ + A; + 1; 

+ logr(^4 + ^^-logr(^^A; 

From the proof of Claim 10 in [20], we can conclude that 

A2 Aa, /. 1 



- — log 1 + — + 0(1 A 



2/3{n2 — n + k) 2 \ n2—n + k^ 

and 

A2 A(a + 1), f^ 1\ ^,, ,,2^ 

The remaining part of fl30|) gives a contribution of 

Aa, / 1 A A(a + 1), / 1, 

We then use that that 

n 

^ 1/A; = log n + c + 0(l/2r2) 
ifc=i 
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to establish the claim in the case where n2/n — )■ 7. In the case where 77-2 3> n, we have 
that Ik = 0{l/n2) and so may be folded into the constant term. Then the remaining 
term in (13T1) gives a contribution of 

log 1 + - 



2 ^\k^ 

which establishes the claim in this case. D 

4.2.3. Checking Assumption 3. To show that the Kc are Hilbert-Schmidt we have the 
following proposition: 

Proposition 22. For any constant C and a > —1, the integral operators on L'^[0, 1] 
with kernels 

where T{x) = ^ (^log ^ + log ^p^T^ j and 

kc{x,y) = Cexp [C{\og{l/x)f' + C{\og{l/y)f/'] y'^/^-^'^+^^Z^ !{,<,} 
are Hilbert-Schmidt. 

Proof. For the operator with kernel fcc,7 the change of variable x'^ + jx — x = e~^ and 
y"^ + 'yy — y = e~* gives the square of the Hilbert-Schmidt norm 

/ / \kc,,{x,y)\'dxdy = C' e^^^'^'+^'M e^^^'^'-^^+^^^rftrfs. 

Jo io io Js 

Similarly for the operator with kernel kc{x,y) we can make the change of variables 
X = e"'' and y = e~* to find the same double integral. This operator is finite if and 
only if a > —1, so both operators are Hilbert-Schmidt. D 

4.3. Checking Assumption 4. To show that the eigenvalues of {KK'^)~^ are simple 
with < Ao < Ai < • • ■ t 00 we make the following observations: 
Observation 1: In the case where n2/n — )■ 7 the spectral problem reads 

(32) f{x) = XK^Kf{x) = \ [ k{y,x) [ k{y,z)f{z)dzdy 



Jo 



A r V2X + 7-1 2y + j-l / T / 2g + 7 - 1 

^^''' 7 A (a;2 + ^a;-x)-/2(l/^ + 71/-l/)'^+^'''^W. V Ps{s + j - 1) ' 



^ Ift^^^'^^ (UpT+7-1)''' 1 ^'^^^''''- 



With a bit of rearranging we find that for 
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under the change of variables {x{x + 7 — l),y{y + 7 — 1), z{z + 7 — 1)) i-t- (7^9, 7g, 'jr) 
with h{p) = g{x) the previous equation reads 

(33) hip) = A /"'r'^e^'^'°^'/^^/i(r) f q-^^+'^e-VP'^'^^'/^^dgdr. 

Jo JpVr 

Observation 2: In the case where n2 ^ n the spectral problem instead reads as 

We then take 

which again yields the equation 

(34) g{x) = \ /^^e^'^'"^'/^^ C y-^''+''>e-V?''^'°^'/y'>g{z)dydz. 



Jo Jxyz 

Equations (!33|) and (IMl) are equivalent to the eigenvalue equation ip = X&p^ai' ([20]. 
Proof of Theoreml). The simplicity of the eigenvalues of ^p^a and their ordering with 
< Ao(/3, a) < Ai(/3, a) < ■ ■ ■ t 00 are discussed by Ramirez and Rider in [2U]. 
We have showed that Theorem [T3] applies to H^n,/3 and the spectrum of the limiting 
operator is the same as that of &/3,a- This completes the proof of Theorem |9l 

5. Appendix: Proof of Theorem [2] 

We will be working primarily with a lower bidiagonal matrix M, and the symmetric 
tridiagonal matrix MM'^ . For convenience we will adopt the following notations. De- 
note the diagonal entries of our symmetric tridiagonal matrix MM'^ by a = {ai, ..., a^} 
and its off-diagonal entries by 6 = {61, ..., bn-i}- For the entries of the bi-diagonal ma- 
trix M use X = {xi, ...,Xn} to denote the diagonal entries and y = {yi, ...,y„_i} for its 
sub-diagonal entries. We will also use another tridiagonal matrix which arises in the 
following lemma (see e.g. [^): 

Lemma 23. Let M be an n x n bidiagonal matrix with ai, 02, . . . , ctn ii^- the diagonal 
and bi,b2, ■ ■ ■ ,bn-i in the off-diagonal. Consider the 2n x 2n symmetric tridiagonal 
matrix L which has zeros in the main diagonal and ai, 61, 02, &2, • • • , ^n above and below 
the diagonal. If the singular values of M are Ai, A2, . . . , A„ then the eigenvalues of L 
are ±Xi,i = 1 . . .n. 

Recall the definitions of M^.„, Ck and Ck from the statement of Theorem [2l It will 
be convenient write {Ci, SiY^^i and {Ci, Si}^Z^ in terms of a set of random angles 
a = {«!,...,«„} and 9 = {9i, ...,9n-i} where Ck = cos(afc) and Ck = cos{9k). Then, 
Sk = sin(afc) and Sk = sin(6'fc), and the densities of the random angles ak and 9k are: 

2 
B (f (ni -n + k), 1(^2 -n + k)) 



fk = -777W-. ^^7 ^cos2«+'^('=-i)+i(a,)sin2^+«^-i)+i(a,) 

' k) 

2 



fk = ,, , = -cos^''{9k)sm^^+''+^^^-'^+^9k) 

■" B (f fc, f (m + n2-2n + k + l)) ^ ' ^ ' 
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with a,b defined as in Theorem [2] and B{x,y) the beta function. By independence, the 
joint density of {a, 6_) is given by the product of the densities. For convenience we will 
denote 

92n-l 

'"'^ riLi 5 (f (ni - n + A;), f (n2 - n + k)) UZl B (f A;, f (ni + ria - 2n + A; + 1)) 

This will be the necessary normalizing constant. 

We will now map (a, ff) to the entries of M and from there to (A, q) where the Aj are 
the eigenvalues of MM'^ and the qi are the positive leading entries of the corresponding 
normalized eigenvectors. This second map will actually by the composition of several 
maps. 
From the angles we map to the entries of the bidiagonal matrix: 

Lemma 24. The Jacohian of the transform T : {a, 9) — )■ {x,y), where 
Xk = cos{ak)sin{6k), k = l,---,n 
Vk = sm{ak+i)cos{9k), A; = 1, ■ ■ ■ ,n - 1. 

(for notational convenience we take On = 7r/2j is given by 

Proof. The matrix of the partial derivatives with ordering (ai, ...,«„, 6'i, ..., 0„^i) — )• 
(xi, ...,Xn,yi, ...,y„_i) has diagonal entries 

— sinai sin 6*1, ...., — sina„_i sin6'„_i, — sina^, — sin 0^2 sin 6^1, ..., — sina„sin6'n_i. 

Row and column reduction gives us that the determinant is given by the product of the 
diagonal, therefore 

JT = -'-^^^P^l\'in\ak)sm'{ek) D 

sm(ai) A^A 

We finish by mapping from the bidiagonal to the tridiagonal matrix, which in turn is 
mapped to by the eigenvalues. Denote by gi, ..., g„ the leading entries of the eigenvectors 
associated with the ordered eigenvalues Ai < A2 < ■ ■ ■ < A„ of the tridiagonal matrix 
normalized so that g^ > and J2li — ^■ 

Lemma 25 ([6J, Lemmas 2.7, 2.9 and 2.11). For x,y,a,b,X and q defined as above we 
have the following: 

(1) The Jacobian of the map tp : (x, y) — )■ (a, 6) can be written as 

n 
i=2 

(2) The Vandermonde determinant for the ordered eigvenvalues of a symmetric 
dridiagonal matrix with positive sub-diagonal b = {bn-i, •••, fei) is given by 



A(A) = n(^^ - ^.) = T^ 

i<j ni=i<di 
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(3) The Jacobian of the map (j) : (a, 6) — ?■ (A, q) can he written as 

Written in terms of our x, y, a, and h with Q^ = HiLi ^« ^^ S^^ 

n-2 
— KWii n.A rciRi n.A pciRiR.. ,1 

g 



J<t> = -py- sin(an) cos(a„) cos(6'„_i) JJ sin(afc+i) cos(afc+i) sin(6'fc+i) cos(6'fc) 



fc=i 

n-l 

2/ 



J^ = 2" cos(ai) sin(6'i) cos^(a„) TT cos^(a;fc) sin 



k=2 

The remainder of the proof of Theorem [2], is to show that the Jacobian of the transfor- 
mation gives the desired result. 



^P^n—^\-Y\{cos^ Vfcsin'^ ^ afc JJ cos^' ^fc sin^' ^6, 



fc=l fc-1 

n-1 
X 

A;=l A:=l 

We substitute in the following pieces: first, notice that 



JJ cos^" ak sin^'' a^ x JJ sin^'^+^fc q^_ 



n n n—1 

(det M„,^)2 = n ^^ = n ^°^' "'^ ■ n ^^^^^ ^'^• 

j=l A:=l fc=l 

Then, applying Lemma [23| the singular values of M„j3 are the squares of the eigenvalues 
of the symmetric tridiagonal matrix L with zeroes in the main diagonal and 

nj 'Jn'-^ra-l) '-^n-l'-'n-l) • • • > ^2'-^l) '-^I'-'l; 

in the off-diagonal. We can check that L + I can be written as AA^ where A is the 
bidiagonal matrix with 

1) Jm »-'n-l) »-'n-l) • • • ) '-'1, and Gn, Gn-1, C^n-lj ^n-2^ • • • ; ^1 

in the diagonal and below the diagonal respectively. Using the characterization from 
Lemma [23| we find that 

n n n—1 

det(L + /)= J] l + ev^= J](l-Afc) = (detA)2 = JJsin^ttfcJJsin^^fc. 

ft=i,-,i k=l k=l k=l 

Remark 26. At this point one could again apply Lemma [23] to A to find a 4n x 4n 
matrix with zeros in the diagonal and 

1) G„, On, C/„_i, o„_i, C„_i, ..., Gi, Oi 



above and below the diagonal. This matrix will have eigenvalue ±a/ 1 ± ^/A^. 
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Lastly recall ([6], Lemma 2.7) that we have 

_ n— 1 _ n n—1 n—1 

^(^) = TT n ^' = TT n ^i^'"' "-^ ^°^'"' "^ ■ n ^°^' ^^^ ■ n ^i^'^' ^^• 
^" fc=i ^" fc=i fc=i fc=i 

Making all the appropriate substitutions this gives us that 

•^^ ^ -^^ ^^ i<j fe=l fc=l 

From this we can see that the joint density function of q and A separate. As in the 
Hermite and Laguerre cases we have that q ~ (x/3, •■■, X/s) normalized to unit length [6]. 
This give us that for the unordered eigenvalues 

I 2 J i<j k=l k=l 

This completes the proof of Theorem [2l D 

Remark 27. The normalizing constant on the final density can be written as 

'/3~ 



Zl3,n 



r . 

2 



-A- r(f(ni + n2-n + A;)) 



Ji r (f (ni - n + k)) r (f (^2 - n + A;)) r (f fc) ' 

This gives an alternate derivation for the Selberg integral. 
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